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We investigate an unconventional nature of the entropy production (EP) in nonequilibrium sys¬ 
tems with odd-parity variables that change signs under time reversal. We consider the Brownian 
motion of a particle in contact with a heat reservoir, where particle momentum is an odd-parity vari¬ 
able. In the presence of an external momentum-dependent force, the EP transferred to environment 
is found not equivalent to usual reservoir entropy change due to heat transfer. There appears an ad¬ 
ditional unconventional contribution to the EP, which is crucial for maintaining the non-negativity 
of the (average) total EP enforced by the thermodynamic second law. A few examples are consid¬ 
ered to elucidate the novel nature of the EP. We also discuss detailed balance conditions with a 
momentum-dependent force. 


I. INTRODUCTION 


Recent studies on nonequilibrium (NEQ) fluctuation 
were motivated W the discovery of the fluctuation the¬ 
orems (FT’s) [il-Q. The FT’s were at first regarded as 
new identities or relations governing thermally fluctuat¬ 
ing quantities in various NFQ dynamics, deterministic 
or stochastic. More recent studies, however, have re¬ 
vealed many interesting properties beyond simple rela¬ 
tions, which include excess and housekeeping (or nonadi- 
abatic and adiabatic) contributions to the entropy pro¬ 
duction (FP) [^-[ijh modifications of FT [l^ - [l^ . in¬ 
formation entropy [idl. [13, multiple dynamical transi¬ 
tions [l^, and persistent initial-memory effect dllig. 

Most of the studies so far have dealt with stochastic 
systems where state variables have even parities (do not 
change signs) under time reversal. This is mainly due 
to technical simplicity and might be also to a naive pre¬ 
sumption that the generalization to the case including 
odd-parity variables might be straightforward. However, 
it has been recently recognized that systems with odd- 
parity variables exhibit a fundamental difference from 
those with even-parity variables only. For example, the 
housekeeping FP does not satisfy the FT any longer and 
can be divided into two parts characterized by the break¬ 
age of detailed balance (DB) and the parity asymmetry of 
the steady-state probability distribution function |10l . [lll |. 

In this study, we report another fundamental difference 
associated with the nature of the FP in systems with 
both even- and odd-parity variables from those with¬ 
out odd-parity variables. To be specific, we consider 
an external momentum-dependent driving force in the 
underdamped Brownian motion. Typical examples are 
velocity-dependent forces in active matter systems [13 
such as granular particles under vibration [22j |. interact¬ 
ing molecular motors [23j |. and active Brownian parti¬ 
cles [13, [13 • Simpler examples are the Lorentz force on 
a charged particle in a uniform magnetic field and an ad¬ 
ditional dissipative force through a feedba ck p rocess in a 
molecular refrigerator (cold damping) [ij, 113 [13 . 


For a system in contact with a single thermal reser¬ 
voir at temperature T, the conventional FP in the NEQ 
steady state can be characterized by an incessant environ¬ 
mental EP mediated solely by heat dissipation Q into the 
reservoir such that ASenv = ASres = QIT. However, we 
find that this relation should be modified in the presence 
of external momentum-dependent forces and there ap¬ 
pears an extra environmental EP, ASuc (unconventional 
EP), yielding ASenv = ASres + ASuc- In some cases, 
we can explicitly show that ASres is negative by itself, 
and the positivity of ASenv is restored by adding ASuc- 
Therefore, the existence of ASuc is crucial for the va¬ 
lidity of the thermodynamic second law [ASenv > 0 in 
the steady state) [13. A similar extra contribution to 
the environmental EP has been considered in Ref. [13 
for a one dimensional system with a simple form of the 
momentum-dependent force. 


II. MODEL 


Consider the driven Brownian motion of a particle of 
mass m in state space q = (x, p), where x and p are the 
position and momentum vectors in d space dimensions, 
respectively. The stochastic differential equation reads 


dx p 
df m ’ 


dt 


f(q; A(t)) - G • — + ^[t ), 

m 


( 1 ) 


where G is a dissipation matrix and a dot (•) between ma¬ 
trices (or vectors) denotes a contraction (inner product). 
The Gaussian noise vector ^{t) satisfies = 

2DS{t — t') with superscript ‘t’ denoting ‘transpose’. The 
diffusion matrix D is positive definite and symmetric. 
The last two terms of the above equation describe ther¬ 
mal forces exerted by heat reservoirs. With a single heat 
reservoir at temperature T, the Einstein relation holds as 
D = TG. The most general form of the force f is consid¬ 
ered, which may depend on both position and momentum 
as well as on a time-dependent protocol X{t). We note 
that previous studies [13 have only focused on the case 
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where f is given by the sum of two terms, one of which 
depends only on position and the other on momentum. 

The corresponding Kramers equation for the probabil¬ 
ity distribution function (PDF), p(q, t), reads 

dtp = -Lp , (2) 

with the evolution operator L as 

L(q) = 5x-^+ap-(f-G. P -D.9p) . (3) 

m V m J 

The formal solution can be written in terms of a path 
integral for 0 < t < r as 

= J dqo J D[q(t)] n[q(t);A(t)] p(qo) , (4) 

with the initial PDF p(qo)- The kernel n[q(t);A(t)] is 
the conditional path probability density of the system 
evolving along a given path {q(t)} for 0 < t < r, starting 
at q(0) = qo- The integration f iA[q(t)] is over all paths 
for given qo and q(T). The probability density to find a 
path {q(t)} is given by P[q{t);X{t)] = n[q(t); A(t)] p(qo). 


III. IRREVERSIBILITY 

Entropy production measures irreversibility of the pro¬ 
cess. To define irreversibility, we first consider the time- 
reverse process which should be governed by the equiv¬ 
alent equation of motion to that of the original (time- 
forward) process in Eq. ([T]): 


The usual (average) total EP, (AS'tot), is obtained by av¬ 
eraging over all possible paths. A simple probability nor¬ 
malization condition results in the integral FT, expressed 
as (e“^‘®‘°‘) = I [1,0. With the Jensen’s inequality, it 
leads to (AStot) > 0, which proves the second law of 
thermodynamics. 

The total EP can be divided into the system entropy 
change and the environmental EP as AStot = ASgys + 
ASenv, where ASsys = -lnp(q(T)) -l-ln/9(qo) is given 
by Shannon entropy difference. Thus, from Eq. ®, the 
environmental EP AiS'enii[q(t)] is simply the logarithm of 
two conditional path probability density ratio. 

It is useful to discretize time such that ti = iAt for 
i = 0,...,N with interval At = t/N for large N. A 
path is now represented by a discrete sequence {q(t)} = 
{qo,..., qi,..., qvr} where q^ = q(ti)- The Markovian 
property of dynamics allows us to write 

N 

n[q(t);A(t)] = ]^r(q,|q,_i; A*_i) (7) 

2=1 


where r(qj|qj_i; Aj_i) = (q^je ^““Iqi-i) is the condi¬ 
tional probability for the system at (q^, ti), starting from 
(qi_i,ti_i) with Ai_i = A(ti_i). Using a quantum me¬ 
chanical formalism for the non-Hermitian evolution op¬ 
erator L, we find 


T(qi|qz—1, Ai_i) 


X exp 



_ J(xj - Xj_i - At p[“Vm) 

I det(47rAtD)|'’*/2 

• D^^ • h-“^ -I- aAt - 9p(c) 
\ m ^ 


( 8 ) 



dx p 
dt m 


^ = f(q;A(t)) - G • — -i-i(t) , 

at m 


(5) 


where all variables in the time-reverse process are de¬ 
noted by overbars. The time-dependent protocol func¬ 
tion A is set by requiring X{i) = X(t). 

For each (time-forward) path {q(t)} (0 < t < t), one 
can consider the corresponding time-reverse path {q(t)} 
for 0 < < < r with t = t — t and q(t) = eq(t), where 
parity e = 1 for position x (even parity) and e = — 1 
for momentum p (odd parity). Note that the odd parity 
for momentum is automatically enforced by identifying 
x(t) = x(t) with t = T — t in Eq. Irreversibility (or 
the total EP, AStot) for a given path {q(t)} is defined by 


AStot [q(f)] = In 


n[q(t); A(t)]p(qo) 
n[q(t); A(t)]p(qo) 


in -P[qW;A(t)] 

P[q(t);A(t)] ’ 


( 6 ) 

where n[q(t);A(t)] is the conditional path probability 
density for the time-reverse path {q(f)} and its initial 
PDP is given as p(qo) = p{q{T)). 

For a reversible path, path probabilities P and P are 
the same by definition and we expect no EP. Deviation 
from this accounts for irreversibility of the path. The 
usual (average) environmental EP, (ASenv), is obtained 
by averaging over all possible paths and the initial PDF. 


where 


^(a) _ Pi 


Aa) 


At 


+ G- 


- f' 


(«) 


(9) 


and p-“^ = (1 — Q!)pi-i -I- api for 0 < a < 1 represents 
an intermediate value of p during time interval 
In principle, a can be arbitrary, but should not affect on 
physical observables like EPs for the large A (small At) 
limit. Porce is also defined in the same manner. 

It is more convenient to consider the EP during an 
infinitesimal time interval [t, t + dt] as 


ASenv — In 


r(q',t-tdt|q,t; A(t)) 
r(eq, t-I-dtjeq', t; A(t)) 


( 10 ) 


where the conditional probability for the time-reverse 
path (q' ^ q) is expressed in terms of that for the time- 
forward path (eq' —>■ eq) in the denominator. Then, a 
straightforward algebra yields 



ai) 

where the force is divided into the reversible and irre¬ 
versible parts, f(q) = f''®''(q)-|-f'"'(q), such that F®''(q) = 
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f''®''(eq) and f‘’^(q) = —f‘'^(eq) [l^. All quantities in 
the above equation should be evaluated at the midpoint 
(a = 1/2; Stratonovich convention). We note that the 
resulting expression is unique with midpoint values, in¬ 
dependent of choices of discretization schemes (i.e. any a 
for the time-forward path and any a for the time-reverse 
path) [ 2 ^. 


IV. CURRENTS 

It is illuminating to consider the average EP in terms 
of currents jq defined by the continuity equation as 

=-i9q • jq =-Lp , (12) 

where jq can be obtained from the evolution operator L 
in Eq. ©• We also divide the currents into the reversible 
and irreversible parts as 

j- = F®''(q)p(q), (13) 

= (f-(q) - G . ^ - D . 5p) p(q) , (14) 

with 

jr = ^p(q) and 3 ^ = 0. (15) 

It is trivial to show that 

Averaging the environmental EP in Eq. (fTTl) . we need to 
evaluate two-time correlators at time t and t-|-dt, such as 
(A(q')B(q)) = /dq'dq A(q')r(q', t-h dt|q, t)B(q)p(q). 
After some algebra, we find the average total EP rate as 

where the inequality (thermodynamic second law) comes 
from the positive-definiteness of D [s^. Only the irre¬ 
versible part jp of the current is a single measure for the 
irreversibility. In the overdamped limit, (jx®'")p averaged 
over p plays an equivalent role, recognized as nonequi¬ 
librium steady-state current in position space . In¬ 

terestingly, (jx'')p 7 ^ 0 is not a necessary condition for 
irreversibility, which will be observed from the second 
example later. 


V. DETAILED BALANCE 

Stochastic reversibility of a given process implies its 
time-reversal symmetry in the probabilistic sense, which 
defines equilibrium. This is also known to be enforced 
by the detailed balance condition (DB) between all pairs 
of microscopic states [11,133. However, when odd-parity 


variables are present, a special care is necessary to re¬ 
late the DB condition to stochastic reversibility. The DB 
condition in general is given in terms of transition rates 
between q and q'{^ q) as 

(q'|L|q)p(q) = (eq|Lkq')p(eq')- (is) 

Conventionally, the mirror symmetry of the steady-state 
PDF, Pss(q) = Pss(eq) is also required for the system to 
be in equilibrium. Recently, it has been reported for dis¬ 
crete state jumping dynamics m that the DB condition 
does not necessarily imply the mirror symmetry and that 
the two conditions are in fact independent. 

For the Brownian motion considered here, we ana¬ 
lyze the DB equation (fT51) without assuming the mir¬ 
ror symmetry beforehand. In terms of the differential 
operator L(q) given in Eq. ([3]), the DB condition is 
L(q')5(q'-q)p(q) = L(eq)(5(q-q')p(eq'). Changing p(q) 
to p(q') on the left-hand side and moving p(eq') on the 
right-hand side to the front, we can rewrite this as 

L(q')/o(q')<5(q' - q) = p(eq')L'^(eq')^(q' - q)) (19) 

where the operator Ll is defined as 

Lt(q) = _ P . _ (f _ P . G‘ + ap . d) • 5p (20) 

Equation (ITOl) can now be regarded as the equality be¬ 
tween the differential operators acting on delta func¬ 
tions. From the part that does not involve any deriva¬ 
tives on the delta function, the steady state condition 
L(q')/o(q') = 0 follows, so p(q') = Pss(q') and i9q • jss,q = 
0 . Comparing the terms proportional to cIxA(q' — q), 
we get the mirror symmetry 


Pss[(3) = Ps8{£(3). ( 21 ) 

Thus, the mirror symmetry is a direct consequence of 
the DB condition for the Brownian dynamics, in contrast 
to discrete state jumping dynamics. For a more general 
continuous stochastic dynamics involving multiplicative 
noises, however, the situation is not so simple. In that 
case, the mirror symmetry follows from the DB only after 
assuming a certain condition for the multiplicative noise 
stren g:ths . In general the two conditions remain indepen¬ 
dent |35l |. The broken mirror symmetry manifests the 
existence of nonzero average current (jx'")p in position 
space, as seen from Eq. (USD. 

The terms proportional to 9p'(5(q' — q) gives the van¬ 
ishing irreversible steady state current 

j^.,p = (f‘^(q) - G . ^ - D . 5 p) P..(q) = 0 . ( 22 ) 

This is consistent with the previous result in Eq. (HZl in 
that the DB condition characterizing equilibrium guar¬ 
antees stochastic reversibility even in the presence of 
momentum-dependent forces. With the broken DB, the 
total EP should increase incessantly in time in NEQ 
steady states. Higher-order derivative terms do not pro¬ 
vide any additional condition. 
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VI. UNCONVENTIONAL EP 


The definition of the environmental EP, Eqs. m and 
(ED, in terms of the irreversibility measure should be 
checked against its conventional definition in thermo¬ 
dynamics. Without any momentum-dependence force, 
f(q) = f(x) = F®'' and F'’ = 0, it has been already 
shown in literatures ii that this definition is consis¬ 
tent with the conventional one. For example, in the case 
of a single heat reservoir at temperature T with D = TG, 
Eq. fTO is simplified as 

dSeuv i f dp £_1^ I'oq', 

dt T\dt J ' m T dt ’ ^ ’ 

where dQ is the heat flow into the reservoir (minus work 
done by the thermal forces) along a given trajectory dur¬ 
ing an infinitesimal time interval dt. (Note that heat 
should be evaluated with the midpoint value of p/m in 
the above equation to maintain the energy conservation 
law [ 3 ^). Thus, the environmental EP is given solely by 
the conventional Clausius EP as dSenv = dSres = dQ/T. 
With general (multiple) reservoirs, we find 


d5e. 


dSr 


dt 


dt 




D 


-1 


G - — . (24) 

m 


With the temperature matrix T = • D and heat 

matrix differential dQ = —(dp — fdt)(p/m)‘, we get 
dSenv = Tr(T“^ ■ dQ*), which can be interpreted as the 
generalized Clausius EP into reservoirs. 

With momentum-dependent forces, it is obvious that 
the (generalized) Clausius EP rate is not identical to 
the environmental EP: Eq. (ED can be rewritten as 
dSenv = dS'res + d^^c, where the unconventional EP 
rate is simply given by the difference between Eqs. ED 
and (|24)l . The unconventional EP may be interpreted 
as an additional EP into the external agent that exerts 
momentum-dependent forces f(q) = f(x, p). However, 
this external agent is not in the conventional form such 
as a thermal reservoir, so it is difficult to understand this 
additional entropy in terms of the conventional thermo¬ 
dynamics. In fact, we do not know whether the uncon¬ 
ventional EP has any feature of the conventional entropic 
measure, though it is evident that it contributes to the ir¬ 
reversibility in Eq. (ED- Note that the unconventional EP 
is present even when f”' = 0, if includes a momentum 
dependence. 

The average reservoir (generalized Clausius) EP rate 
can be obtained via a similar algebra used in deriving 
Eq. (fT71) as 



and similarly we find 



dSu, 

dt 


= / dq p(q) 


F’'.D-*.fr-2Gi^ 

V m 

-dp ■ (F®'^ - P)] . (26) 


These two EP rates sum up into the average environ¬ 
mental EP rate which is consistent with the difference 
between Eqs. ED and dUD- 


VII. EXAMPLES 


We now demonstrate the novelty and importance of the 
unconventional EP in a few examples that may be real¬ 
ized in experiments. First, we investigate a cold-damping 
problem with a dissipative external force, f'’’ = —G'-p/m 
with a positive-definite G'. For simplicity, we take f''®'' = 
0, G = 7 !, and D = Dl in two dimensions with the iden¬ 
tity matrix I and the reservoir temperature T = D/j. 
The steady-state PDF, Pss(q), can be easily obtained in 
any linear diffusion system, shown in Refs. [3 and [s^. 

For given G' = 7 ^ ^ ^ ^ with a, b > 0 and > ab, a 

straightforward algebra with Eqs. ED and (l2^ yields 



7 (q - b)^ 
m 2(1 -I- r) 

7 4(1 -I- r)^ -I- (a — 5)^ 

m 2(1-I-r) {(1-I-r)^ — a&} 


(27) 


As the average system EP vanishes in the steady state, 
(dSuc/dt) is simply the difference between the above two 
EP rates. We can see explicitly that the reservoir EP 
rate (heat production rate) can be negative for large r, 
but the total EP rate remains positive (thermodynamic 
second law) due to the unconventional EP contribution. 

In a cold-damping problem, heat should flow into 
the system at a lower temperature from the higher- 
temperature reservoir in the steady state, which dissi¬ 
pates by the additional dissipative external force. Thus, 
the reservoir entropy decreases incessantly, which is com¬ 
pensated and usually overridden by the unconventional 
EP to maintain the thermodynamic second law. In a 
practical cold-damping problem, a feedback mechanism 
through measurement of a particle momentum operates 
continuously as this additional dissipative force, thus a 
usual information entropy (mutual information) [l^ en¬ 
ters into the total EP in addition, which will be discussed 
elsewhere [3^ . 

As a second example, we consider the case with f*’’ = 
—A • p/m with an antisymmetric A = —A*. Taking 
pev — _g^Y D — TG, this can describe a charged 
particle motion under a confined potential V (x) with a 
magnetic field, in contact with a single temperature reser¬ 
voir. From Eqs. m and m, it is easy to show that 
Pss(q) cx; e“r{p / 2 m-i-v(x)}^ which is the same Boltz¬ 
mann distribution as for the equilibrium case without 
F''. We find {dSres/dt) = 0 (no heat production because 
F'' does not work) from Eq. (1^51) . but the DB is broken 
due to a nonzero irreversible current in the momentum 
space as in Eq. ED, leading to a nonzero total EP in the 
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steady state in Eq. (El) , as 

jiVp = -A • ^Pss , (^) = -Tr [G-iAA‘] . (28) 
m \ at / m 

Note that the unconventional EP is the only source for 
the total EP in this case. 

Eor a charged particle motion in two dimensions with 
an external uniform magnetic field B applied in the per¬ 
pendicular direction, the antisymmetric matrix can be 

written as A = B ^ ^ (dS'tot/dt) = 

2 i 3 ^/( 7 m) with G = 7 I. Due to the mirror symmetry in 
the steady state, there is no net current in position space, 
(jx'')p = 0 - system in a confined geometry, one 

can expect a boundary current, which represents irre¬ 
versibility in position space, even though there is no net 
bulk current. Irreversibility in momentum space implies 
the existence of a residual force persistent in thermal fluc¬ 
tuation, which can be observed in this example from the 
helicity describing the tendency of circulation around the 
external magnetic field. The helicity can be measured by 
{p{t + At) X p{t))/{At) for At —)■ 0 with the cross prod¬ 
uct X, which can be found as / dp j‘/j, p x p = 2TB. 
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